Spatiotemporal model of human vision for digital video compression

We propose a new model for the prediction of distortion visibility in digital image sequences, which is aimed at use in digital video compression algorithms. The model is an extension of our spatial vision model with a spatio-temporal contrast sensitivity function and an eye movement estimation algorithm. Due to the importance of smooth pursuit eye movements when viewing image sequences, eye movements cannot be neglected in a spatio-temporal vision model. Although eye movements can be incorporated by motion compensation of the contrast sensitivity function, the requirements for this motion compensation are different than those for motion compensated prediction in video coding. We propose an algorithm for the estimation of smooth pursuit eye movements, under the worst-case assumption that the observer is capable of tracking all objects in the image.